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Abstract 

In this paper we consider the problem of reconstructing a hidden weighted hypergraph of constant rank 
using additive queries. We prove the following: Let G be a weighted hidden hypergraph of constant rank 
with n vertices and m hyperedges. For any m there exists a non-adaptive algorithm that finds the edges of 
the graph and their weights using 

^ f mlogn' 

additive queries. This solves the open problem in [S. Choi, J. H. Kim. Optimal Query Complexity Bounds for 
Finding Graphs. STOC, 749-758, 2008]. 

When the weights of the hypergraph are integers that are less than 0{poly{n'^ /m)) where d is the rank of 
the hypergraph (and therefore for unweighted hypergraphs) there exists a non-adaptive algorithm that finds 
the edges of the graph and their weights using 



logm 



additive queries. 

Using the information theoretic bound the above query complexities are tight. 

1 Introduction 

In this paper we consider the following problem of reconstructing weighted hypergraphs of constant ran lfl(the 
maximal size of a hyperedge) using additive queries; Let G — {V, E, w) be a weighted hidden hypergraph where 
E C 2^, |e| is constant for all e G E, w : E ^ R, and n is the number of vertices in V. Denote by m the size 
of E. Suppose that the set of vertices V is known and the set of edges E is unknown. Given a set of vertices 
S CV, an additive query, Qg{S), returns the sum of weights in the sub- hypergraph induced by S. That is, 

QciS)^ ^ wie). 
Our goal is to exactly reconstruct the set of edges using additive queries. 

One can distinguish between two types of algorithms to solve the problem. Adaptive algorithms are algorithms 
that take into account outcomes of previous queries while non-adaptive algorithms make all queries in advance, 



^Sometimes called dimension. 
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Figure 1: Results for weighted and un- weighted hypergraphs with optimal query complexity. non-optimal 
adaptive query complexity algorithm for Hypergraph can be found in [12]. § A non-optimal non-adaptive query 
complexity algorithms can be found in [20j and the references within it. 



before any answer is known. In this paper, we consider non-adaptive algorithms for the problem. Our concern is 
the query complexity, that is, the number of queries needed to be asked in order to reconstruct the hypergraph. 

The hypergraph reconstructing problem has known a significant progress in the past decade. For unweighted 
hypergraph of rank d the information theoretic lower bound gives 




for the query complexity for any adaptive algorithm for this problem. 

Many independent results [131 |T71 [IH E] have proved a tight upper bound for hypergraph of rank 1, i.e., loops. A 
tight upper bound was proved for some subclasses of unweighted hypergraphs of rank two, i,e., graphs (Hamil- 
tonian graphs, matching, stars and cHques etc.) [T^ HH [T71 [7] , unweighted graphs with n{dn) edges where the 
degree of each vertex is bounded by d [17], graphs with r2(n^) edges [17] and then the former was extended to 
d-degenerate unweighted graphs with {l{dn) edges [19], i.e., graphs that their edges can be changed to directed 
edges where the out-degree of each vertex is bounded by d. A recent paper by Choi and Kim, [TT] , gave a tight 
upper bound for all unweighted graphs. In this paper we give a tight upper bound for all unweighted hypergraphs 
of constant rank. Our bound is tight even for weighted hypergraphs with integer weights |w| = poly{n'^ /m) 
where d is the rank of the hypergraph. 

For weighted hypergraph of constant rank with unbounded weights the information theoretic lower bound gives 

^/mlognX 
V logm J 

In [11], Choi and Kim prove a tight upper bound for loops (hypergraph of rank 1). For weighted graphs (hyper- 
graph of rank 2) Choi and Kim, [TT], proved the following: If m > (logn)" for sufficiently large a, then, there 



2 



exists a non-adaptive algorithm for reconstructing a weighted graph where the weights are real numbers bounded 
between n~" and n'' for any positive constants a and b using 



O 



( 



m log n 



logm 



) 



queries. 



In [9j, Bshouty and Mazzawi close the gap in m and proved that for any weighted graph where the weights are 
bounded between and for any positive constants a and h and any m there exists a non-adaptive algorithm 
that reconstructs the hidden graph using 



queries. Then in |10| they extended the result to any weighted graph with any unbounded weights. 

In this paper extend all the above results to any hypergraph of constant rank, i.e., the edges of the graph has 
constant size. This solves the open problems in [TTl l9l ITO]. 

The paper is organized as follows: In Section 2, we present notation, basic tools and some background. In 
Section 3, we prove the main result. 

2 Preliminaries 

In this section we present some background, basic tools and notation. 

For an integer r let [r] be the set {1,2, . . . ,r}. For S C [r] we define x^' £ {0, 1}'' where = 1 if and only if 
i G S. The inverse operation is S'^ — {i \ Xi = 1}. We say that xi,...,Xd £ {0, 1}" are pairwise disjoint if for 
every i ^ j, we have Xi 'if Xj — where * is component-wise product of two vectors. For a prime p and integers a 
and b we write a —p b for a = b mod p. We will also allow p — oo. In this case a and b can be any real numbers 
and a —oo b will mean a = 6 as real numbers. 

2.1 d-Dimensional Matrices 

A d- dimensional matrix A of size ni x ■ ■ ■ x over a field F is a map A : Y[i=i[^i] ~^ ^- We denote by ]F"ix -x"<i 
the set of all d-dimensional matrices A of size ni x ■ • • x n^. We write Aij^. .^^^ for A(ii, . . . , id). 

The zero map is denoted by 0"i^ "^"''. The matrix 



where Ij C [uj], is the x • • ■ x \Id\ matrix where Bj-^^,,,_j^ = ^£i,...,£^ and ii is the j'^th smallest number in 7^. 
When = [ rij] we just write J and when — {£} we just write j — £. For example, (^ii,i2,...,iti)ii,i2=^,i36J2,- -,i£ie/d ~ 



When m = ^2 = • • ■ = n<j = n then we denote F"!^ '^"'' by F^"*" and 0"i^- -^"<* by 0^"". 

We say that the entry Aij^i^^. .^^^ is of dimension r if . . . , id}\ — r. For rf-dimensional matrix A we denote by 
wt{A) the number of points in HiLiI'^i] that are mapped to non-zero elements in F. We denote by wtr{A) the 
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number of points in HiLil'^i] of dimension r that are mapped to non-zero elements in F. Therefore, wt{A) = 

wti{A)+wt2{A)-\ \-wtd{A). We denote by Ad,m the set of rf-dimensional matrices A G F^<*" where wt4{A) < m 

and ^ the set of d-dimensional matrices A G F^<*" where 1 < wtd{A) < m. 

For rf-dimensional matrix A of size rii x ■ ■ ■ x Ud and Xi G F"* we define 

, . . . , Xd) = ^ ] • • • ^ ^ ,i2,...,id'^lii ' ' ■ -^did • 
ii=l i<i=l 

The vector v = A{-, X2, - ■ ■ , Xd) is ni-dimensional vector that its ith entry is 



A. . . . . . -T. ,. 

d' 



«2=1 jd = l 



For a set of d-dimensional matrices B, a set 5 C ({0, 1}")'* is called a zero test set for B if for every A G B, A ^ 0, 
there is x G S such that A(a;) ^ 0. 

A d-dimensional matrix is called symmetric if for every i = {ii,...,id) S [n]'' and any permutation (ji on [d], 
we have = A^i, where (pi — («</,(i), ■ • ■ ,i,p{d))- Notice that for a symmetric ci-dimensional matrix A G F^-*", 
Xi G {0, 1}" and any permutation ^ on [d\, we have A{xi, . . . , x^) = A(a;0(i), . . . , x^^^^))- 

Wc will be interested mainly in the fields F = R the field of real numbers and F = Zp the field of integers modulo p 
and in matrices of constant d = 0{1) dimension. Also p > d\. Although it seems that we are restricting the 
parameters, the final result has no restriction on the parameters except for d = 0(1). We will also abuse the 
notations Zp and ~p and allow p = oo (so in this paper oo is also prime number). In that case = M. and 
is equality in the filed of real numbers. 



2.2 Hypergraph 

A hypergraph G is a pair G = {V, E) where V = [n\ is a set of elements, called nodes or vertices, and E is & set of 
non-empty subsets of 2^ called hyperedges or edges. The rank r{G) of a hypergraph G is the maximum cardinality 
of any of the edges in the hypergraph. A hypergraph is called d-uniform if all of its edges are of size d. 

A weighted hypergraph G — {V,E,w) over Zp is a hypergraph (V, E) with a weight function w : E ^ Zp. For 
two weighted hypergraph Gi = {V,Ei,wi) and G2 = {V,E2,'W2) we define the weighted hypergraph Gi — G2 = 
{VjEjW) where E = {e £ EiU E2 \ wi(e) ^ W2{e)}, and for every e G E, w{e) = wi{e) — iU2{e). Obviously, 
Gi = G2 if and only if Gi — G2 is an independent set, i.e., E = 

Wc denote by Qd the set of all weighted hypergraphs over Zp of rank at most d, Qd.m the set of all weighted 
hypergraphs over Zp of rank at most d and at most m edges and ^ the set of all weighted hypergraphs over 
Zp of rank d and at most m edges. 

Let w* -.2^ ^ Zp be w extended to all possible edges where for e G E, w*{e) = w(e) and for e ^ E, w*(e) = 0. 

An adjacency d- dimensional matrix of a weighted hypergraph G is a d-dimensional matrix where d > r{G) 
such that for every set e = {ii,i2, ■ ■ ■ ,ie} of size at most d we have A^^.^ .^-^ =p w* {e) / N [d, (.) for all ji,. ■ . ,jd 
such that {ji,j2, ...,jd} = {ii,---, if] where 

N{dA) = Y,{-ir(%-iY. 



4 



That is, N{d,£) is the number of possible sequences {ji, . . . , jd) such that = {ii, ■ • • , Note that 

N{d,tj <d\ <p and therefore N{d,t) and is well defined. 

It is easy to see that the adjacency matrix of a weighted hypergraph is a symmetric matrix and r{G) = r if and 
only if the adjacency matrix of G has an non-zero entry of dimension r and all entries of dimension greater than r 
are zero. 

2.3 Additive Model 

In the Additive Model the goal is to exactly learn a hidden hypergraph with minimal number of additive queries. 
Given a set of vertices S" C an additive query, Qa{S), returns the sum of weights in the subgraph induces 
by S. That is, Qg{S) —p X]ee_En2s w(e). Our goal is to exactly reconstruct the set of edges and find their weights 
using additive queries. See the many applications of this problem in [71 [TTl [T^ . 

We say that the set S = {Si, 5*2, • ■ • , 5^} C 2^ is a detecting set for Gd,m if for any hypergraph G G Gd,m there 
is Si such that QciSi) ^ 0. We say that the set S = {5*1, 5'2, • • ■ , Sk} C 2^ is a search set for Qd^m if for any two 
distinct hypergraphs Gi,G2 G Gd.m there is Si such that QaiiSi) ^ QoiiSi)- That is, given {QG{Si))i one can 
uniquely determines G. We now prove the following. 

Lemma 1. If S ~ {Si, S2, ■ ■ ■ , S^} C 2^ is a detecting set for Gd,2m then it is a search set for Gd,m- 

Proof. Let Gi,G2 G Gd.m be two distinct weighted hypergraphs. Let G = Gi — G2. Since G G Gd,2m there must 
heS.eS such that Qg(^») ^ 0. Since QaiS.,) - Qg, iS^) - Qg, iS^) we have Qg^ (S^) ^ Qg, (5.)'. □ 

2.4 Algebraic View of the Model 

It is easy to show that for any hypergraph G of rank r the adjacency d-dimensional matrix of G, , for d > r, 
is symmetric, contains a nonzero entry of dimension r and 

QGiS) A'^{x^x'^,.f.,x'^)^Bfix'^). 

For a symmetric d-dimensional matrix A let B{x) —p A{x, x, .'}.,x) where x G {0, 1}". When xi, . . . ,Xd G {0, 1}" 
are pairwise disjoint the following lemma shows that A{xi, . . . ,Xd) can be found by 2'^ values of B. 

Lemma 2. //xi, . . . , G {0, 1}" are pairwise disjoint then 

A{xi, ...,Xd)=p\^Y. (-1)'"'"^ ( E A ■ 

■ /e2M Vie/ / 

Proof. Since 

A{xi +x[,X2, ...,Xd)=p A{xi,X2, ...,Xd)+ A{x[,X2, ...,Xd) 

and 

A{xi,X2,...,Xd) =p ^(a;0(i),a;0(2), . . . 
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for any permutation (f> on [d], the result is analogous to the fact that 

d 

(1) 



2/12/2 ••■ yd =p ^ II ' 

■ /e2[<'i Vie/ / 



for formal variables yi, . . . ,yd- Now notice that 



Vie/ / gi+ - +gd=d 



2/f •••2/r, 



where x[^] = 1 if the statement L is true and otherwise. Therefore, the coefficient of yf^ ■ ■ ■ y'^J^ in the right 
hand side of ([T]) is 



/e2M 

d 

91 92 • • • 



Now if ^ = \{i\q^ 7^ 0}| < d then 



E (-i)'"'"x[{*k.7^o}c/] 

/e2i<'i 



If ^ = 7^ 0}| = d then = q2 = ■ ■ ■ = qd = I and 

E (-1)'"'"X[{^I*7^0}C/] 1. 
/e2Mi 

This implies the result. □ 

Let G be a hypergraph of rank d and G^*' , i < d, be the sub-hypergraph of G that contains all the edges in G of 
size i then 

Lemma 3. If xi, . . . , Xd {0, 1}" are pairwise disjoint then, we have that A'^{xi, . . . , Xd) — ' (xi, . . . , Xd)- 
In particular, if r{G) < d then A'^{xi, . . . ,Xd) = 0. 

Proof. Since xi, . . . , G {0, 1}" are pairwise disjoint we have 

"1 "d in* (^^i i i }) 
Aj^{xi,. . . , Xd) — 2. ■ ' ■ E AT I /I If '■ ^TTT^i'i ' ■ ' ^<^i<i 

_ w*{{ii,i2, ■ . ■,id}) 

^ N{d,d) ^^n■■■Xd^, 

= A^*'"(a;i,...,Xd). 



Now when r(G) < d then G^''-' is an mdependent set (has no edges) and A^'''' = 0. Then 

□ 

We now prove 

Lemma 4. Let $rf = {zf'\ ■ . ■ , ^IfJ} C ({0, 1}")'' where for every i the vectors Zj-'^^ . . . , z['^'^ are pairwise disjoint. 
If is a zero test set for (d!)m then 



is a detecting set for Q*^ , 



Proof. Let $d be a zero test set for ^* {d\)m- ^ ^ ^dm- Then Ajf ^ and A'^ e ^* (d!)m- Therefore, for 
every G e there is zf^ such that A^(zf ') / 0. By Lemma H 



and therefore for some Jq C [d], 

which imphes that Qg (S'^ 'o) ^ for j/,7„ = X^jeJo j'*' 
We now show 

Lemma 5. A detecting set for Qd.m over Zp is a detecting set for Qd.m over M. 

Proof. Consider a detecting set S = {Si, 82, - ■ ■ , Sk} Q 2^ for Qd,m over Zp. Consider a. k x q matrix M where 

d / 

n 



E 

1=0 



that its cohimns are labeUed with sets in 2["1 of size at most d and for every S C [n] of size at most d we have 
M[i, 5"] = 1 if 5 C S'j and otherwise. Consider for every graph G € Gd.m a g-vector vg that its entries are 
labelled with subsets of [n] of size at most d and vg[S] = w*{S). The labels in vg are in the same order as the 
labels of the columns of M. Then it is easy to see that 

MVG =p {QG{Sl),...,QG{Sk)f. 
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Since Mvg T^p for every vq G of weight at least one and at most m, every m columns in M are linearly 
independent over Zp. Since the entries of M are zeros and ones every m columns in M are linearly independent 
over R. Therefore, 

MvG^iQGiSl),...,QG{Sk)f y^O, 

for every vq G of weight at least 1 and at most m. □ 



2.5 Distributions 

In this subsection we give a distribution that will be used in this paper. 
The uniform disjoint distribution fld.n{x) over ({0, l}")'* is defined as 

PPy^ Xi, . . . ,Xd is pairwise disjoint. 
otherwise. 

In order to choose a random vector x according to the uniform disjoint distribution, one can randomly in- 
dependently uniformly choose n elements wi^W2, ■ ■ ■ ,Wn where Wi £ [d + 1] and define the following vector 
x = {xi,X2,...,Xd) e ({0,1}")'': 

_ J 1 j = Wi and Wi G [d] 
[0 otherwise. 

We call any index k G [n] such that Xjk — for all j G [d] a free index. Let Td^n C ({0, 1}")'* be the set of all 
pairwise disjoint c?-tuple. 




2.6 Preliminary Results 

In this section we prove, 

Lemma 6. Let A G F^"*" \ {O^'*"'} be an adjacency d-dimensional matrix of a hypergraph G of rank d. Let 
X = {xi,X2, • • . , Xd) G ({0, 1}")'' be a randomly chosen d-tuple, that is chosen according to the distribution fld,n- 
Then 

Pr [A{x) = 0] < 1 - , , \, , . 

Proof. Let e = {ii, . . . ,id} be an edge of size |e| — d and let x'j = (xj , . . . , x^^i^). Consider 4>{x'i, . . . ,x'^) 
that is equal to A{x) with some fixed Xj i — i G {0, 1} for i ^ e. Since A{x) contains the monomial M — 
Xi^i-^X2,i2 • ■ ■ Xd.ia ^-nd no other monomial in A{x) contains it, (j) contains monomial M and therefore 

(bix[,...,x'd)^0. 

If we substitute Xj-^^i-^ ~ Q \n (p for all ji ^ j2 we still get a nonzero function , 0:2,^2 ,•• ■ ,Xd,ia) that 

contains M. Therefore, there is ^ = (CijijC2i2i ' ' ' i^dia) G {0,1}'' such that (/)'{(,) ^ 0. The probability that 
(xi^i^,a;2,i2i ' ■ ■ i^d.id) — C and Xj^Sj^ = for all ji ^ j2 is (l/d+ 1)''. This implies the result. □ 

We will also use the following two lemmas from [51 [TU] . 
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Lemma 7. Let a € be a non-zero vector, where p > wt{a) is a prime number. Then for a uniformly randomly 
chosen vector x G {0, 1}" we have 

Pi[a^x =p 0] < 



wtia)0' 

where P = ^^j;^ = 0.278943 • ■ • . 

Let t be a function on non-negative integers defined as follows: t(0) = 1 and = i for i > 0. 



Lemma 8. Let mi, m2, . . . , nit be integers in [m\ U {0} such that mi +rn2 + ■ ■ ■ + mt = I > t. Then H'^q L{rni) > 
toL(^-*)/('»-i)J. 



3 Reconstructing Hypergraphs 

In this section we prove, 

Theorem 1. There is a search set for Qd,m over R of size k — O ^ "I'pg'm" 

Theorem 2. There is a search set for G'd,m over R of size k = O ^ , where Q' d,m denotes the set of 

all weighted hypergraphs over R of rank at most d, at most m edges and weights that are integers bounded by 
w = poly{n'^ /m). 

Proof. We give the proof of Theorem [1] The proof of Theorem [5] is similar. More details in the full paper. 

Let m < p < 2m be a prime number. Suppose there is a zero test set from Td^n for ^ over Zp of size T{n, m, d). 
By Lemma m there is a detecting set for ^^^'^ 2^T{n, {d\)m,d). Therefore, by Lemma [3l there is 

a detecting set for Gd,m over Zp of size T'{n,m,d) = J2i=i 2^T{n, {£[)m,£). By Lemma[Sl there is a detecting set 
for Gd,m. over R of size T'{n, m, d). Finally, by Lemma [1] there is a search set for Qd,m over R of size T'(n, 2m, d). 
Now for constant d, if 

then T'{n,2m,d) = 0{T{n,m,d)). Therefore it is enough to prove the following. 

Lemma 9. Let p be a prime number such that m < p < 2m. There exists a set S — {xi,X2, ■ ■ ■ ,Xk} ^ ({0, 1}")'^ 
where Xi = {xi,i, . . . ,Xi^d) G ^d,n for i G [k] and 



k = 



m log n 
logm 



such that: for every d-dimensional matrix A G \ {0^''"} with 1 < wtd{A) < m there exists an i such that 

A{x,) 0. 
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Proof. Since wtd{A) > 1 the matrix A has at least one nonzero entry of dimension d. We will assume that all the 
entries of dimension less than d are zero, that is, wt{A) — wtj_(A). This is because, by Lemma [31 the entries of 
dimension less than d have no effect when the vectors Xi € Td^n- 

We divide the set of such matrices ^ = | A G \ {0^'*"} and wt{A) < m} into d + 1 (non-disjoint) sets: 

• Aq: The set of all non-zero matrices A G Z^^*" such that wt{A) < m/logm. 

• Aj for j = 1, . . . , d: The set of all non-zero matrices A G Zp such that m > wt{A) > to/ log to and there 
are at least 

TO ^ 



Jogm^ 

non-zero elements in Ij ^ {ij|3(ii,i2, ■ • ■ ■ ■ ■ : Ai^A^^,,,^^ / 0}. 

Note that / = {(ii,i2, ■ ■ ■ , id)|^ii,i2,...,id ^ 0} Ii ^ h x ■ ■ ■ x Id and therefore either / = wt{A) < m/logTO or 
there is j such that \ > (to/ log to)^/"*. Therefore, ^ = ^ U U • • • U Ad- 

Using the probabilistic method, we give d + 1 sets of pairwise disjoint tuples of vectors 5*0, S'l, . . . , S'd such that 
for every j G {0} U [d] and A G Aj there exists a d-tuple x in Sj such that A(x) ^ and 



|5ol + l^i| + --- + l^d| = 



TO log 71 
log TO 



Case 1: yl G A^: For a random d-tuple x, chosen according to the distribution ^d,n we have that 

Pr[A(.).,0]<l-^. 

If we randomly choose 

cm log n 
fci = -j 

log TO 

d-tuples, Xi, . . . according to the distribution Jl^.n, then the probability that A(xi) = for all i G [fci] is 

(d+l)° 



Pr[Vz G [k^] : =p 0] < A - 



Therefore, by union bound, the probability that there exists a matrix A G Ao such that A{xi) = for all i G [ki] 
is 

n'' \ ^ / 1 



Vv[3AeA^.yie[ki]:A{xi)=pQ\ < „ pis?^ 1 



log m 



(d+l)"* 



for some constant c. This implies the result. 



Case2: A G .4j where j — 1, . . . ,d: We will assume w.l.o.g that j — 1. We first prove the following lemma 
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Lemma 10. Let U C Zp'' ^" be the set of all d— 1- dimensional matrices with weight smaller than For 
A ^ U let T(A) C [n] be following set 

^i^) = {j I ^Ai,i2....,id-i 7^ and j ^ {ii,i2, ■ ■ -Jd-i}}- 
Define Q — {{A,j) \AgU and j G T{A)}. Then, there is a constant cq such that for every C > Cq and 

^mlogn 



log TO 



there exists a multi-set of d — 1-tuples of (O,l)-vectors Z = {zi, Z2, ■ ■ ■ , ^fcj} C ({0, i}")<*~i such that for every 
{A,j) G Q the size of the set 

Z(A,j) = {i 1^(2^0 7^ and j is a free index} 

is at least 

Proof. Let Zi = {zi^i, Zi^2, ■ ■ ■ , Zi^d-i) G ({0,1}")'^^"'^ be random d— 1-tuple of (0, l)-vector chosen according to 
the distribution n^-i^n- For G Q, and by Lemina[6l we have 

Pr [^(^^i) 7^ and j is a free] = Pi[j is free] Pr[A(zi) 7^ 0|j is free] > - ■ ^^ ^^ ~ 



Therefore, the expected size of ^(Aj) is greater than By Chernoff bound, if we randomly choose all Zi, z G [^2] 
according to the distribution rid-i,n, then, we have 

Pr \Z^A,,)\<^ <el^. 



Thus, the probability that there exists G Q such that < ^ is 

fc2 



Pr 



3(A,j) gQ: < 



2d<^ 



^ \Ql^ |^x[n]| ^ n{J;:,,)p-''''^'' 



Z±2 



Z±2 

e sd'^ 



Cm log , 
g 8d<i log ,1 



< 



tUd/(d+l)j^ 

C(loge)Tn — Cc'm ^ 



for large enough C. This implies the result. 



□ 



Now, Let U and Q be the sets we defined in Lemma [TUl Let A £ Ai- Since wt{A) < m there are at most m^/'^'*+^^ 
d — 1-dimensional matrices {Ai-^^i2,...^i^)i-^=j^i2,...,ia with weight greater than m'^/*^'^+^^ Therefore, there is at least 



log TO 



l/d 



indices j such that {Ai-^_i^,_,^i^)i-^=j^i2^,,,^i^ G [/. Let C/' contain any q indices such that (Ai-^ 
Let Ati be the matrix 



I2,...,ldjtl=],l2,---,ld 



G C/. 



(^ii,i2,...,id )jiet^',i2,---,id • 
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Let zi,Z2, . . . ,Zk2 G ({0, be the set we proved its existence in Lemma ITOl We now choose Xi G {0, 1}", 

i S [k2] in the following way: Take Zi. For every free index j, choose Xij to be "1" with probability 1/2 and 
"0" with probability 1/2 (independently for every j). All other entries in Xi are zero, that is, all entries that 
correspond to non-free index j in Zi are zero. Let u € {0, 1}" be a vector where Uj — 1 if j € U' and zero 
otherwise. Also, for a d — 1-tuple Zi let Vi G {0, 1}" be the vector where Vij — 1 ii j is a free index in Zi and 
Vij ~ otherwise. By Lemma [7| we have that 

Pr[A(a;,,0,) =p 0] < TT— — ^ - IT f ^ At 

X -^.^ L[wt[Vi * A{-, Zi)))P L[wt{Vi * [U * A(-, Zi))))P 

Note that, A is a hypergraph, thus, for every j such that (A^j i^ ...^,;^)jj=j^i2,...,id ^ we have that 



Therefore, 



Using Lemma |S] we have 



^ wt{vi * (w * A{-, Zi))) > 



Y[ i{wt{v, *{u* A{-,Zi)))) > q 



L q-1 J = m'^i'^s 



Therefore, using (jSJ, Pra;[v4(xi, z^) =p 0] < ^^^^j^fc^- Thus, the probabihty that there exists a matrix A ^ Ai such 
that for all i G [/C2] we have A{xi, zi) = is 



lAI ^ CJP" < r^-n" 

for large enough constant. This implies Lemma [H □ 



Pt\A(x^, Zi) 01 < ' ' < < 777- < 1, 



This completes the proof of Theorem [TJ □ 
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